A Simple Smooth Backfitting Method for Additive Models
نویسنده
چکیده
In this paper a new smooth backfitting estimate is proposed for additive regression models. The estimate has the simple structure of Nadaraya–Watson smooth backfitting but at the same time achieves the oracle property of local linear smooth backfitting. Each component is estimated with the same asymptotic accuracy as if the other components were known. 1. Introduction. In additive models it is assumed that the influence of different covariates enters separately into the regression model and that the regression function can be modeled as the sum of the single influences. This is often a plausible assumption. It circumvents fitting of high-dimensional curves and for this reason it avoids the so-called curse of dimensionality. On the other hand, it is a very flexible model that also allows good approximations for more complex structures. Furthermore, the low-dimensional curves fitted in the additive model can be easily visualized in plots. This allows a good data-analytic interpretation of the qualitative influence of single co-variates. In this paper we propose a new backfitting estimate for additive regression models. The estimate is a modification of the smooth backfitting estimate of Mammen, Linton and Nielsen [9]. Their versions of smooth backfitting have been introduced for Nadaraya–Watson smoothing and for local linear smoothing. Smooth backfitting based on Nadaraya–Watson smoothing has the advantage of being easily implemented and of having rather simple intuitive interpretations. On the other hand, local linear smooth backfitting
منابع مشابه
Smooth Backfitting for Additive Modeling with Small Errors-in-Variables, with an Application to Additive Functional Regression for Multiple Predictor Functions
We study smooth backfitting when there are errors-in-variables, which is motivated by functional additive models for a functional regression model with a scalar response and multiple functional predictors that are additive in the functional principal components of the predictor processes. The development of a new smooth backfitting technique for the estimation of the additive component function...
متن کاملBandwidth Selection for Smooth Backfitting in Additive Models
The smooth backfitting introduced byMammen, Linton and Nielsen [Ann. Statist. 27 (1999) 1443–1490] is a promising technique to fit additive regression models and is known to achieve the oracle efficiency bound. In this paper, we propose and discuss three fully automated bandwidth selection methods for smooth backfitting in additive models. The first one is a penalized least squares approach whi...
متن کاملNonparametric Lag Selection for Additive Models Based on the Smooth Backfitting Estimator
This paper proposes a nonparametric FPE-like procedure based on the smooth backfitting estimator when the additive structure is a priori known. This procedure can be expected to perform well because of its well-known finite sample performance of the smooth backfitting estimator. Consistency of our procedure is established under very general conditions, including heteroskedasticity.
متن کاملSmooth Backfitting in Generalized Additive Models
Generalized additive models have been popular among statisticians and data analysts in multivariate nonparametric regression with non-Gaussian responses including binary and count data. In this paper, a new likelihood approach for fitting generalized additive models is proposed. It aims to maximize a smoothed likelihood. The additive functions are estimated by solving a system of nonlinear inte...
متن کاملA Note on The Backfitting Estimation of Additive Models
The additive model is one of the most popular semiparametric models. The backfitting estimation (Buja, Hastie and Tibshirani, 1989, Ann. Statist.) for the model is intuitively easy to understand and theoretically most efficient (Opsomer and Ruppert, 1997, Ann. Statist.); its implementation is equivalent to solving simple linear equations. However, convergence of the algorithm is very difficult ...
متن کامل